Language learning with interactive virtual agent scenarios and speech recognition: Lessons learned
نویسندگان
چکیده
The SPELL (Spoken Electronic Language Learning) system is a self-access computer-assisted language learning (CALL) package that integrates speaker-independent continuous speech recognition technology with virtual worlds and embodied virtual agents to create an environment in which learners can converse in the target language within meaningful contextualized scenarios. In this paper we provide an overview of the functionality, architecture, and implementation of the SPELL system. We also describe four phases of usability evaluation conductedwith the system and summarize the main results of these user assessments. Finally, we discuss the most significant lessons learned in the development and evaluation of the system. The paper focuses on the technological aspects of the system and its evaluation for usability and robustness, rather than its pedagogical methodology. Copyright # 2008 John Wiley & Sons, Ltd.
منابع مشابه
EmoEmma: Emotional Speech Input for Interactive Storytelling (Demo Paper)
Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors with...
متن کاملEmoEmma: emotional speech input for interactive storytelling
Whilst techniques for narrative generation and agent behaviour have made significant progress in recent years, natural language processing remains a bottleneck hampering the scalability of Interactive Storytelling systems. This demonstrator introduces a novel interaction technique based solely on emotional speech recognition. It allows the user to use speech to interact with virtual actors with...
متن کاملThe More the Merrier: Multi-Party Negotiation with Virtual Humans
The goal of the Virtual Humans Project at the University of Southern California’s Institute for Creative Technologies is to enrich virtual training environments with virtual humans – autonomous agents that support face-to-face interaction with trainees in a variety of roles – through bringing together many different areas of research including speech recognition, natural language understanding,...
متن کاملAttitudes towards Subtitles and their Effect on User Responses in Speech Interactive Foreign Language Learning
The use of subtitles in a Computer Assisted Language Learning (CALL) program can assist learners in the comprehension of the language input they are exposed to. In an interactive CALL program, subtitles may also help learners in the formulation of their own responses. This paper describes the evaluation of a speech interactive CALL program that combines speech recognition technology, embodied a...
متن کاملA New Method for Speech Enhancement Based on Incoherent Model Learning in Wavelet Transform Domain
Quality of speech signal significantly reduces in the presence of environmental noise signals and leads to the imperfect performance of hearing aid devices, automatic speech recognition systems, and mobile phones. In this paper, the single channel speech enhancement of the corrupted signals by the additive noise signals is considered. A dictionary-based algorithm is proposed to train the speech...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Journal of Visualization and Computer Animation
دوره 19 شماره
صفحات -
تاریخ انتشار 2008